Generation of multimodal dialogue for net environments
نویسندگان
چکیده
In this paper an architecture and special purpose markup language for simulated affective face-to-face communication is presented. In systems based on this architecture, users will be able to watch embodied conversational agents interact with each other in virtual locations on the internet. The markup language, or Rich Representation Language (RRL), has been designed to provide an integrated representation of speech, gesture, posture and facial animation.
منابع مشابه
Student-Sensitive Multimodal Explanation Generation for 3D Learning Environments
Intelligent multimedia systems hold great promise for knowledge-based learning environments. BeCallSe f)f re(:eltt a(lvan(:es in OllF Iln(lerstaIl(ling how to dynamically generate multimodal explanations and the rapid growth in the performance of 3[) graphics technologies, it is becoming feasible to create multimodal explanation generators that operate in re~ltime. Perhaps most (:ompelling abou...
متن کاملStudent Sensitive Multimodal Explanation Generation for D Learning Environments
Intelligent multimedia systems hold great promise for knowledge based learning environments Be cause of recent advances in our understanding of how to dynamically generate multimodal explana tions and the rapid growth in the performance of D graphics technologies it is becoming feasible to create multimodal explanation generators that operate in realtime Perhaps most compelling about these deve...
متن کاملMultimodal Language Processing For
Interfaces for mobile information access need to allow users flexibility in their choice of modes and interaction style in accordance with their preferences, the task at hand, and their physical and social environment. This paper describes the approach to multimodal language processing in MATCH (Multimodal Access To City Help), a mobile multimodal speech-pen interface to restaurant and subway i...
متن کاملMultimodal Dialogue Management in the COMIC Project
The next generation internet applications will feature not only the ability to understand spoken and written natural language text, (pen) gestures and body postures, they will also and importantly be able to engage with the user in a natural dialogue about the application. In this paper we will describe the design of a multimodal dialogue and action management module, part of the COMIC demonstr...
متن کاملA trainable generator for recommendations in multimodal dialog
As the complexity of spoken dialogue systems has increased, there has been increasing interest spoken language generation (SLG). SLG promises portability across application domains and dialogue situations through the development of applicationindependent linguistic modules. However in practice, rulebased SLGs often have to be tuned to the application. Recently, a number of research groups have ...
متن کامل